Cloth Capture (sketches 0390)

Overview We present a method for capturing the geometry and parameterization of fast-moving cloth using multiple video cameras, without requiring camera calibration. Our cloth is printed with a multi-scale pattern that allows capture at both high speed and high spatial resolution even though self-occlusion might block any individual camera from seeing the majority of the cloth. We show how to incorporate knowledge of this pattern into conventional structurefrom-motion approaches, and use a novel scheme for camera calibration using the pattern. We use bundle adjustment to obtain accurate reconstruction results and use the parameterization to drive several stages of post processing including strain reduction and a cloth simulation to fill in gaps. We demonstrate our algorithm by capturing, retexturing and displaying several sequences of fast moving cloth.